Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable x-pack security for testing against snapshots #28131

Merged
merged 58 commits into from
Jan 25, 2022

Conversation

cachedout
Copy link
Contributor

@cachedout cachedout commented Sep 27, 2021

What does this PR do?

Closes #27211

This turns on xpack security for testing against snapshots (currently against 8.0.0).

Why is it important?

Per the requesting issue: As Elasticsearch is enabling security by default in 8.0 we should also do this for our testing to uncover potential issues early on.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

  • [ ]

How to test this PR locally

Run make up from testing/environments. Ensure that the environment comes up successfully.

Related issues

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Sep 27, 2021
@mergify mergify bot added the backport-skip Skip notification from the automated backport with mergify label Sep 27, 2021
@cachedout
Copy link
Contributor Author

Clearly this PR is missing some auth goodness being injected into the tests themselves. I'll keep investigating that angle before this is ready for review.

Copy link
Member

@ruflin ruflin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this definitively goes into the right direction! I expect some other integration tests to blow up.

One thing I thought would happen in 8.0 is that https is turned on by default, but it seems this is not the case?

testing/environments/snapshot.yml Outdated Show resolved Hide resolved
@jsoriano jsoriano added the Team:Automation Label for the Observability productivity team label Oct 25, 2021
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 25, 2021
@jlind23
Copy link
Collaborator

jlind23 commented Nov 18, 2021

hey @cachedout any updates there?

@cachedout
Copy link
Contributor Author

@belimawr Would you mind re-reviewing this when you have a moment? I would like to get this in somewhat soon and avoid a lengthy round of having to rebase it. :) Thanks!

Copy link
Contributor

@belimawr belimawr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cachedout LGTM, could you look into the failing tests?

@jlind23
Copy link
Collaborator

jlind23 commented Jan 4, 2022

@KseniaElastic @elastic/observablt-robots as @cachedout is out could you help us out? Seems to be ready to be merged.

@jlind23
Copy link
Collaborator

jlind23 commented Jan 6, 2022

@v1v can i have your help here?

@v1v
Copy link
Member

v1v commented Jan 6, 2022

@Mergifyio update

@v1v
Copy link
Member

v1v commented Jan 6, 2022

@v1v can I have your help here?

I just rebased this PR with the latest changes in the master branch, therefore a new build should happen soon.

Other than that, it might be better if someone from the Beats team take the lead and review those changes.

@jlind23
Copy link
Collaborator

jlind23 commented Jan 6, 2022

The review was done by @belimawr so we should be good to go.

@mergify
Copy link
Contributor

mergify bot commented Jan 6, 2022

update

✅ Branch has been successfully updated

@v1v
Copy link
Member

v1v commented Jan 6, 2022

/test

@v1v
Copy link
Member

v1v commented Jan 6, 2022

As far I see there are some IntegTest failures for:

  • metricbeat-goIntegTest
  • x-pack/libbeat-goIntegTest
  • x-pack/libbeat-pythonIntegTest

No idea if they are related to this change or flaky tests. I just commented with /test, so a new build will tell the new findings 🤞

OTOH, I have not seen any approval of this particular PR. Mike is on PTO for a while, so either we wait for until then (in a few months) or if this is needed now, maybe @belimawr or someone else within the Beats team can take the ownership of this particular PR and move forward? What do you think?

@jlind23
Copy link
Collaborator

jlind23 commented Jan 10, 2022

@belimawr could you give us your approval here?

@mergify
Copy link
Contributor

mergify bot commented Jan 13, 2022

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b xpack_security_test upstream/xpack_security_test
git merge upstream/master
git push upstream xpack_security_test

@belimawr
Copy link
Contributor

As far I see there are some IntegTest failures for:

  • metricbeat-goIntegTest
  • x-pack/libbeat-goIntegTest
  • x-pack/libbeat-pythonIntegTest

No idea if they are related to this change or flaky tests. I just commented with /test, so a new build will tell the new findings crossed_fingers

OTOH, I have not seen any approval of this particular PR. Mike is on PTO for a while, so either we wait for until then (in a few months) or if this is needed now, maybe @belimawr or someone else within the Beats team can take the ownership of this particular PR and move forward? What do you think?

I have the feeling some of those might be flaky tests, I had metricbeat-goIntegTest randomly failing on some PRs totally unrelated to it, a couple of /test did the trick for me.

I'm reviewing the PR and I'll also look into those failing tests.

@v1v @jlind23 a quick question: I see there are some conflicts on this PR, who should fix them? Should I fully take over the PR or just the review?

Either way is fine for me.

@jlind23
Copy link
Collaborator

jlind23 commented Jan 13, 2022

@belimawr as @cachedout is out for a couple of more weeks, that would be great if you can take the ownership of this.

@belimawr
Copy link
Contributor

@belimawr as @cachedout is out for a couple of more weeks, that would be great if you can take the ownership of this.

I'm on it!

@belimawr
Copy link
Contributor

/test

@belimawr belimawr self-assigned this Jan 20, 2022
@belimawr belimawr merged commit 1a3dbb5 into elastic:master Jan 25, 2022
yashtewari pushed a commit to build-security/beats that referenced this pull request Jan 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-skip Skip notification from the automated backport with mergify cleanup Team:Automation Label for the Observability productivity team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Turn on security for testing
7 participants